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DEPARTMENT  OF  EDUCATION 

Office  of  Vocational  and  Adult 
Education 

Cooperative  Demonstration  Program 

agency:  Department  of  Education. 
action:  Notice  of  Proposed  Priority  and 
Selection  Criteria  for  Fiscal  Years  1988 
and  1989. 

summary:  The  U.S.  Secretary  of 
Education  (Secretary)  proposes  to 
establish  an  absolute  priority  for  the 
Hscal  years  1988  and  1989  grant 
competitions  under  the  Cooperative 
Demonstration  Program.  Under  the 
priority,  funds  would  be  reserved  for 
exemplary  dropout  prevention  and 
reent^  projects  in  vocational  education 
that  would  be  coordinated  with  an  in- 
depth  Federal  evaluation  of  this 
program.  The  Secretary  also  proposes  to 
use  new  selection  criteria  in  evaluating 
applications  submitted  for  this 
competition. 

date:  Comments  must  be  received  on  or 
before  August  25, 1988. 

ADDRESS:  Comments  should  be 
addressed  to  Kate  Holmberg,  National 
Projects  Branch,  Division  of  Innovation 
and  Development,  Office  of  Vocational 
and  Adult  Education  (Room  519, 
Reporters  Building),  400  Maryland 
Avenue  SW.,  Washington,  DC  20202- 
5516.  Telephone  (202)  732-2363. 
SUPPLEMENTARY  INFORMATION: 

Program  Information 

Although  some  statistics  indicate  that 
the  overall  dropout  rate  in  this  country 
may  have  leveled  off  or  even  decreased 
slightly  in  recent  years,  the  dropout  rate 
for  some  disadvantaged  groups  has 
become  intolerably  high.  In  addition, 
there  are  fewer  career  opportunities  for 
those  who  drop  out,  as  often  they  do  not 
possess  even  the  most  basic  skills 
required  for  most  jobs. 

The  problem  of  high  school  dropouts 
is  highlighted  in  the  Senate  Report  No. 
100-189  for  Pub.  L.  100-202  (Continuing 
Appropriations  for  Fiscal  Year  1988).  In 
this  report,  the  Congress  directed  the 
Department  of  Education  to  make 
available  $4,787,000  to  support 
exemplary  dropout  prevention  and 
reenti7  programs  within  vocational 
education.  In  addition,  the  Department 
is  to  evaluate  the  effectiveness  of  these 
programs.  It  is  clear  that  Congress 
recognizes  the  serious,  negative  effects 
that  the  dropout  problem  has  on  our 
society  and  intends  that  funds  be  used 
to  ameliorate  this  problem  through  the 
use  of  vocational  education. 

Many  education  program 
administrators  believe  that  participation 


in  vocational  education  programs  can  in 
itself  help  to  lower  dropout  rates. 
Moreover,  certain  components  of 
vocational  training  such  as  job 
readiness  training,  work  experience,  and 
indivdualized  instruction  have  been 
found  to  be  very  effective  in  working 
with  potential  or  actual  dropouts.  This 
program  will  be  able  to  test  these 
theories  in  order  to  demonstrate 
vocational  education’s  role  in  dropout 
prevention. 

The  Secretary,  therefore,  proposes  to 
award  grants  under  the  Cooperative 
Demonstration  Program  for  model 
exemplary  projects  that  have  proven  to 
be  effective  in  dealing  with  the  problems 
of  potential  or  actual  dropouts. 
Applicants  must  be  able  to  provide 
evidence  of  program  success  based  on 
past  performance. 

In  order  to  assess  the  effectiveness  of 
the  projects  funded  and  to  identify 
which  of  the  exemplary  projects  have 
models  most  suitable  for  replication,  the 
Department  of  Education  will  conduct 
an  independent  evaluation  under  this 
program. 

Priority 

In  accordance  with  the  Education 
Department  General  Administrative 
Regulations  (EDGAR),  34  CFR 
75.105(c)(3),  the  Secretary  proposes  to 
establish  an  absolute  priority  by 
reserving  funds  under  the  Cooperative 
Demonstration  Program  in  Hscal  years 
1988  and  1989  to  support  exemplary 
models  of  dropout  and  reentry  projects 
within  vocational  education.  Projects 
must  exhibit  exemplary  approaches  for 
encouraging  vocational  education 
students  to  remain  in  school  or  for 
encouraging  dropouts  to  reenter  school 
(or  other  alternative  training  programs) 
through  vocational  education  programs. 
Exemplary  approaches  in  past 
successful  dropout  projects  have 
included  such  factors  as  small  class 
size,  individualized  treatment, 
recruitment,  and  thorough  assessment 
and  feedback  on  student  progress  as  a 
part  of  their  comprehensive  programs.  In 
addition,  projects  should  be  located  in 
communities  with  high  dropout  rates. 

Applicants  must  provide  evidence  of 
the  success  of  the  approach  the  project 
will  demonstrate.  Results  of  past 
performance  must  include  empirical 
data  on  the  performance  of  project 
participants  such  as  improved  dropout 
rates,  increased  attendance  rates,  and 
successful  grade  progression. 

All  applicants  must  agree  to 
participate,  if  selected,  in  a  Federal 
evaluation.  That  evaluation  would 
require  the  applicants  to  establish 
control  groups  through  random 
assignment  of  participants  to  their 


projects  or  to  establish  comparison 
groups  through  matched  pairs. 

Applicants  that  are  prohibited  by  State 
law  from  engaging  in  random 
assignment  will  be  excused  from 
consideration  for  this  approach  but  may 
still  be  required  to  participate  in  the 
Federal  evaluation  throu^  a  matched 
pairs  design. 

Federal  Evaluation 

The  Secretary  intends  to  conduct  an 
independent  evaluation  of  the 
effectiveness  of  as  many  as  two-thirds 
of  the  dropout  prevention  and  reentry 
demonstration  projects  funded  under 
this  program.  This  in-depth  evaluation 
will  require  detailed  collection  of  data 
on  the  project  and  participants,  entailing 
some  additional  effort  on  the  part  of 
project  staff  in  recordkeeping.  The  in- 
depth  evaluation  will  involve  the  use  of 
comparison  groups  developed  through: 

•  Random  assignment  of  potentially 
eligible  participants  to  the  program  or 
the  control  group,  or 

•  The  use  of  matched  pairs — a 
method  that  identifies  non  participants 
who  have  characteristics  that  are 
similar  to  those  of  the  program 
participants. 

The  appropriate  method  of  selecting  a 
comparison  group  will  be  determined, 
based  on  program  characteristics,  by  an 
independent  evaluator  under  contract 
with  the  U.S.  Department  of  Education. 
A  project  will  need  more  potentially 
eligible  participants  than  openings  to 
qualify  for  random  assignment.  In  order 
to  match  pairs,  there  must  be  a  readily 
identifiable  population  from  which 
selections  can  be  made. 

Random  Assignment 

Random  assignment  of  potentially 
eligible  participants  is  the  most  rigorous 
method  of  evaluating  program  effects. 
When  participants  are  randomly 
assigned  to  a  program  or  to  a  control 
group,  all  independent  variables  (i.e. 
ability,  motivation,  socioeconomic 
background)  are  controlled.  Individuals 
in  the  control  group  will  receive  no 
services  from  the  project  funded  under 
this  program,  but  will  be  free  to  receive 
other  available  services.  The  use  of  the 
random  assignment  methodology  is  to 
test  the  impact  of  the  program  on 
participants  versus  the  impact  of  other 
available  services  on  individuals  with 
similar  characteristics. 

Matched  Pairs 

An  alternative  evaluation  design  is 
the  selection  of  a  comparison  group  that 
is  matched  with  the  participant  group  on 
various  characteristics.  While  this 
design  is  used  more  frequently  than 
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random  assignment,  it  is  less  rigorous.  It 
is  difficult  to  match  participants,  with 
non-participants  on  multiple 
characteristics.  As  a  result,  differences 
in  outcome  measures  between  program 
participants  and  persons  in  the  matched 
comparison  groups  are  sometimes  not 
necessarily  related  to  program  effects, 
but  rather  to  factors  not  matched.  For 
instance,  one  of  the  most  difficult 
factors  to  control  for  in  a  matched 
evaluation  design  is  motivation. 

Program  participants  could  be  expected 
to  be  more  motivated  than  non¬ 
participants  unless  program  participants 
are  randomly  assigned. 

The  contractor  will  work  closely  with 
each  project  selected  for  in-depth 
evaluation  in  implementing  the 
evaluation  design  procedures.  In  the 
Spring  of  1989,  the  contractor  will  visit 
the  selected  project  sites  to  observe 
program  characteristics  and  practices 
such  as  problems  and  successes  with 
program  implementation,  the 
employment  of  program  strategies,  and 
staff  and  participant  interactions. 

The  in-depth  evaluation  will  be 
implemented  beginning  in  the  Fall  of 
1989.  Participants  and  controls  will  be 
assigned  by  the  contractor  through 
random  assignment  or  matched  pairing. 
Data  will  be  collected  from  program 
participants  and  controls  on  factors 
such  as  demographic  characteristics, 
family  background,  academic  history, 
test  scores,  educational  expectations, 
and  attitudes  toward  education. 

Program  participants  who  complete  an 
open  exit  program  or  leave  the  program 
prior  to  completion  will  be  followed  up 
on  an  ongoing  basis.  Participants  and 
controls  will  be  followed  up  in  the 
Spring  of  1990  and  Spring  of  1991  to 
collect  information  on  outcome 
measures  such  as  attendance,  program 
or  school  retention,  academic  progress, 
vocational  training,  educational 
expectations,  program  completion,  and 
job  placement.  The  evaluation  of  the 
effectiveness  of  dropout  prevention  and 
reentry  programs  in  vocational 
education  will  be  based  on  a 
comparison  of  program  participants  and 
controls  on  these  outcome  measures. 

Applicants  should  plan  and  budget  for 
their  own  independent  evaluations  in 
the  event  they  are  not  selected  to 
participate  in  the  Federal  evaluation. 
The  contractor  will  be  available  to 
provide  technical  assistance  to  projects 
not  selected  for  Federal  evaluation, 
including  assistance  in  reHning  the 
design  of  their  evaluation,  data 
collection  procedures,  and  survey  forms, 
to  facilitate  the  collection  of  comparable 
data  by  all  funded  projects.  The 
Secretary  will  consider  that  the 


evaluation  requirements  on  34  CFR 
75.590  are  met  by  a  grantee’s 
participation  in  the  in-depth  Federal 
evaluation. 

Criteria  For  Evaluating  Applications 

The  Secretry  proposes  to  use  the 
following  selection  criteria  and  to  assign 
points  as  indicated,  for  this  competition 
only. 

(a)  Need  (15  points) 

The  Secretary  reviews  each 
application  to  determine  the  extent  to 
which  the  project  addresses  the  needs  of 
the  targeted  population,  including — 

(1)  A  clear  description  of  the  needs  of 
the  proposed  target  population; 

(2)  Characteristics  of  that  population, 
including  numbers  to  be  served  directly; 

(3)  The  definition  of  dropout  used  by 
the  applicant’s  community  and  how  the 
dropout  rates  in  the  application  were 
computed; 

(4)  Specific  evidence  of  how  the 
proposed  project  will  meet  the  needs  of 
the  target  population; 

(5)  A  description  of  any  ongoing  and 
planned  activities  in  the  commimity 
relative  to  the  need,  including,  if 
appropriate,  the  relationship  to  the  State 
Plan  for  Vocational  Education; 

(6)  A  clear  statement  of  what  the 
project  seeks  to  demonstrate. 

(b)  Plan  of  Operation  (20  points] 

The  Secretary  reviews  each 

application  to  determine  the  quality  of 
the  plan  of  operation  for  the  project, 
including — 

(1)  A  management  plan  that  describes 
the  chain  of  command,  how  staff  will  be 
managed,  how  coordination  among  staff 
will  be  accomplished,  and  timelines  for 
each  activity; 

(2)  A  clear  description  of  the 
interrelationship  of  goals,  objectives, 
and  activities; 

(3)  The  way  the  applicant  plans  to  use 
he  resources  and  personnel  from  the 
grant  to  achieve  each  objective;  and 

(4)  A  clear  description  of  how  the 
applicant  will  provide  equal  access  and 
treatment  for  eligible  project 
participants  who  are  members  of  groups 
that  have  been  traditionally 
underrepresented.  These  groups  may 
include — 

(i)  Members  of  racial  or  ethnic 
minority  groups; 

(ii)  Women; 

(iii)  Handicapped  persons;  and 

(iv)  The  elderly. 

(c)  Program  Factors  (25  points) 

The  Secretary  reviews  each 

application  to  determine  the  extent  to 
which  there  is — 

(1)  A  clear  description  of  the  model  to 
be  used,  including  services  to  be 
provided,  who  will  provide  them,  and 
how  they  will  be  provided; 


(2)  Evidence  of  past  successful 
performance  using  this  model  to  include 
empirical  data  such  as  lowered 
droupout  rates,  successful  grade 
progression,  improved  attendance,  and 
increased  graduation  of  GED  rates; 

(3)  A  complete  description  of  the 
methodology  to  be  used  including  some 
or  all  of  the  following  components — 

(i)  A  thorough  assessment  of 
individual  students; 

(ii)  Flexibility  in  the  structure  of  the 
present  delivery  system,  e.g.,  in 
classroom  hours,  use  of  additional  staff, 
classroom  location,  and  student-teacher 
ratios; 

(iii)  Active  recruitment  activities; 

(iv)  Small  class  size; 

(v)  Thorough  assessment  and 
feedback  of  student  progress; 

(vi)  Individualized  treatment; 

(vii)  Coordination  of  vocational 
instruction,  academic  instruction,  and 
counselling  services; 

(viii)  Inclusion  of  some  relevant  work- 
related  experience;  and 

(ix)  Community  and  business 
involvement, 

(d)  Quality  of  Key  Personnel  (15 
points) 

(1)  The  Secretary  reviews  each 
application  to  determine  the  quality  of 
key  personnel  the  applicant  plans  to  use 
on  the  project  including — 

(1)  The  qualibcations  of  the  project 
director; 

(ii)  The  qualifications  of  each  of  the 
other  key  personnel  to  be  used  on  the 
project; 

(iii)  The  time,  including  justification 
for  the  time,  that  each  one  of  the  key 
personnel,  including  the  project  director, 
will  commit  to  the  proposed  project;  and 

(iv)  How  the  applicant,  as  part  of  its 
nondiscriminatory  employment 
practices,  will  ensure  that  its  personnel 
for  this  project  are  selected  for 
employment  without  regard  to  race, 
color,  national  origin,  gender,  age,  or 
handicapping  condition. 

(2)  To  determine  personnel 
qualifications,  the  Secretary  considers 
experience  and  training  in  fields 
particularly  related  to  the  objectives  of 
the  project,  as  well  as  other  information 
that  the  applicant  provides. 

(e)  Evaluation  Plan  (15  points) 

The  Secretary  reviews  each 

application  to  determine  the  quality  of 
the  project’s  independent  evaluation 
plan  for  the  project,  including  the  extent 
to  which — 

(1)  The  plan  includes  activities  during 
the  formative  stages  of  the  project  to 
help  to  guide  and  improve  the  project,  as 
well  as  a  final  evaluation  that  includes 
summary  data  and  recommendations; 
and 
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(2)  The  plan  includes,  at  a  minimum,  a 
description  of  the  participant  data  to  be 
collected  based  on  the  project 
objectives;  tracking  and  followup  of 
progress  by  all  project  participants 
throughout  the  project  period,  and 
outcome  measures  to  be  used  for  each 
objective. 

(f)  Budget  and  Cost-Effectiveness  (5 
points) 

The  Secretary  reviews  each 
application  to  determine  the  extent  to 
which — 

(1)  The  budget  is  detailed  and  tied  to 
the  proposed  activities; 

(2)  The  budget  narrative  is 
explanatory  and  justibes  expenses; 

(3)  The  budget  is  adequate  to  support 
the  project;  and 

(4)  Costs  are  reasonable  in  relation  to 
the  objectives  of  the  project. 


(g)  Adequacy  of  Resources  (5  points) 
The  Secretary  reviews  each 
application  to  determine  the  adequacy 
of  the  resources,  other  than  those 
provided  by  this  program,  and  that  the 
applicant  plans  to  devote  to  the  project, 
including  facilities,  equipment,  and 
supplies. 

Additional  Consideration 

The  Secretary  further  proposes  that,  in 
selecting  applications  for  funding,  the 
Secretary  may  consider  whether  funding 
a  particular  application  would 
contribute  to  the  funding  of  a  variety  of 
approaches. 

Invitation  to  Comment 

Interested  persons  are  invited  to 
submit  comments  and  recommendations 
regarding  (a)  the  proposed  priority  for 


dropout  prevention  and  reentry  projects 
including  the  proposed  Federal 
evaluation  and  related  requirements; 
and  (b)  the  proposed  criteria. 

All  comments  submitted  in  response 
to  this  notice  will  be  available  for  public 
inspection  during  and  after  the  comment 
period  in  Room  519,  Reporters  Building, 
300  7th  Street  SW.,  Washington,  DC, 
between  the  hours  of  9:30  a.m.  and  3:00 
p.m.,  Monday  through  Friday  of  each 
week  except  Federal  holidays. 

(Authority:  20  U.S.C.  2411) 

Dated:  June  10, 1988. 

William ).  Bennett, 

Secretary  of  Education. 

[FR  Doc.  88-16731  Filed  7-25-88;  8:45  am) 
BILLING  CODE  4000-01-M 


